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17 APR'tMS 


The Honorable Lionel H. Olmer 
Under Secretary for International Trade 
United States Department of Comnerce 
Washington, D.C. 20230 


Dear Lionel, 

around the middle of the year. 


The starting point for our study Is the description of our methods of 
»ctlmat1na Soviet economic growth published In 1982 by the Joint Economic 
roranittee^of Congress. That document Included discussions of the accuracy of 
«”rjS!po'neS?s'oTli;e 2t1.,tes. but its pri«ry «« ?"es‘tS 

5rSs on thSt e^H ter lort but shifts the focus onto the Issue of accuracy. 


<b.veral other recent aad longer-term considerations— with which you are 
familiar— contributed to our decision to report on how accurately we can 
measure Soviet economic growth; 

0 The panel of economic experts that reviewed our estimates for 
the President's Foreign Intelligence Advisory Board 
recommended that we "make more of an effort Jo establish an 
upper and lower bound for the possible error In our growth 

measures. 

♦ 

0 In a separate paper prepared for the PFIAB at your request, 

Michael Boretsky claimed that our growth estimates are 
seriously biased downward. , 


25X1 


25X1 


CL BY Signer 

25X1 


SOV M 85 - 10073 


CONFIDENTIAL 


Sanitized Copy Approved for Release 2009/12/09 : CIA-RDP85T01058R000507500001-9 





Sanitized Copy Approved for Release 2009/12/09 : CIA-RDP85T01058R000507500001-9 

CONFIDENTIAL 


The Honorable Lionel H. Olmer 


More recently, there has been a development with which you may not- be 
familiar. A working group of knowledgeable acadMics appointed by the DDI 
concluded that our growth estimates are If anything overstated. 

Our analysis Indicates that estimated growth of Soviet 6NP may be 
understated slightly, but not by more than half a 

and probably by less. Estimates for some Individual components of GNP are 
subject to greater error than the summary measure, but Individual er rors In 
opposite directions help reduce the overall error. 


The most Important sources of error leading to the small net 
understatement In our estimates of GNP growth probably are: 


0 


Some understatement of growth In Industries like chemicals 
and construction materials, where Improvements In the mix and 
quality of products are not fully captured by our estimates. 


0 Some overstatement of machinery growth because our estimates 
rely heavily on official Soviet measures that probably 
exaggerate Improvements In quality, especially for new 
products. 


0 A slight understatement In growth of consumer services, 
mostly because our estimates do not allo w for modest 
Improvements In the quality of housing. 


Some of the errors In our estimates of Soviet economic growth result from 
problems that affect even countries with good, open statistical 
Improvements In quality, for'example, cannot be taken 
without knowing and assessing a wide range of product characteristics. 


Although we find that our estimates of Soviet GNP growth j;;® P^JP^bly 

understated somewhat, the errors are much less from 

maintains. His efforts to extend our samples and methods of estimation frm 
the USSR to the US and the Federal Republic of Germany aro Jf® 

believe however, that these extensions reflect more on the poor match between 
the Soviet product sample and output In the se countries than on the accuracy 
of our measures of Soviet economic growth. 


Finally, we should correct for the record Boretsky's Impression that our 
estimates of Soviet defense spending are derived from our estlmates^of GNP 
growtb^C "The Tenablllty of CIA Estimates of Soviet Economic Grwth, July 
1983 pages 35-36). Defense spending Is estimated Independently by costing a 
detailed^llst of the physical elements of Soviet defense programs. I 
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The Honorable Lionel H. Olmer 


We will forward a copy of our full report when it is completed. In the 
meantime, we stand ready to discuss our work with members of your staff as you 
deem appropriate. | 


Sincerely, 


Deputy Director of Soviet Analysis 
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The Honorable Lionel H. Olmer 


Distribution: 

Original - Addressee 
2 - D/SOVA 
1 - DD/SOVA 
1 - NIO/USSR-EE 
1 - NIO/ECON 
5 - CPAS/IMC/CDP/CB 
1 - Chief, NIG 
1 - Chief, NIG/EPD 
1 - Chief, NIG/DPD 
1 - Chief, SIG 
1 - Chief, SIG/SFD 
1 - Chief, SIG/SPD 
1 - Chief, RIG 
1 - Chief, RIG/EAD 
1 - Chief, RIG/TWAD 
1 - Chief, DEIG 
1 - Chief, DEIG/DID 
1 - Chief, DEIG/DEA 
1 - Chief, DEA/DE 
1 - Chief, DEA/SA 
1 - Chief, DEA/CA 
1 - DEA/DE Chrono 


DDI/SOVA/DEIG/DEA/DE 


17 April 1985 
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Attachnent 

TESTS OF CIA MEASURES OF SOVIET ECONOMIC PERFORMANCE 


BACKGROUND 

The Soviets publish statistics on net material product, a measure similar 
to’ gross national product (6NP). This official measure, however. Is not fully 
comparable with GNP estimates for Western countries. Net material Product has 
three major shortcomings that lead us to develop Independent estimates of 
Soviet GNP: 

0 Most services— aside from freight transportation and 
wholesale and retail trade— are excluded. 

0 Output Is said to be valued In constant prices, but those 
prices Include a substantial degree of disguised 
Infl atlon. 

0 Methods used to derive the official measure are not 
described adequately. 

Our Independent estimates of Soviet economic performance are Intended to 
rSied/thesrshortcomlngs and to achieve comparability with Western measures 

of GNP. 


Outside reviewers often have commented, sometimes critically, on our 
estimates of Soviet GNP and Its growth. In an assessment requested by the 
President's Foreign Intelligence Advisory Board (PFIAB), « 
experts found our estimates "calculated with essentially state-of-the-art 
methodology and with a high level of skill, attention to detail, 
sophistication." At the same time, however, the panel 

"nake more of an effort to establish an upper and lower bound for Jfe possible 
error" In our growth estimates. And a separate paper prepared by Michael 
Boretsky for the PFIAB ("The Tenablllty of CIA Estimates of ^vlet Economic 
Growth," July 1983) charged that our measure ^nt techniques Impart serious 
downward bias to growth as we estimate It. ' ' 


The present summary of our analysis of our own accuracy In estimating 
Soviet GNP growth attempts to address both the recommendation of the expert 
panel and the major Issues raised by Boretsky. In examining potential sources 
of error, we seek to assess the directlon-especlally any bias upward or 
downward— and rough size of their effects. The data themselves, most of which 
come from Soviet open sour ces, are assumed a ccurate except when there is 
evidence to the contrary. 


MEASUREMENT OF ECONOMIC GROWTH 

To estimate growth of Soviet GNP, we start from a base year (1970) for 
which Information Is as complete and detailed as possible. Our goal is to 
measure growth of real value added— that Is, growth of Income-producing 
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activities, excluding the effects of price changes. Value added consists of 
total Income generated by primary Inputs to production: labor, capital, and 
land. Inputs of processed goods and services from producing enterprises are 
excluded because each product must be counted only once, rather than as many 
times as It Is bought or sold. Growth Is estimated for the producing sectors 
In which value added originates, or sectors of origin. Industry, agriculture, 

and construction produce material goods, while service sectors Include^ 

transportation and trade as well as consumer and government services. 

The accuracy of our estimates of 6NP growth depends mainly on how well 
changes over time are measured for the major sectors of origin. To estimate 
growth of GNP, we must rely on samples and assume that activities we cannot 
observe grow at the same rate as something we can observe. The key problems 
of measuring changes over time can be grouped In three categories: 

0 Finding samples of products that cover the full range of 
output In each sector of origin. 

0 Allowing for changes In the mix and quality of products 
In the samples. 

0 Choosing proxies for val ue added when 1 ts growth cannot 
be measured adequately. I 


ADEQUACY OF SAMPLES 

Products omitted from the samples we use In estimating Soviet economic 
growth may grow at different rates than the products Included. Ue try to 
minimize resulting errors by making the samples as complete and representative 
as possible. Despite our efforts, however, there are gaps In coverage, 
especially of activities about which the Soviets are sensitive. And In a 
number of cases the samples do not capture Introduction of new products, so 
growth Is understated. " 

The coverage of our samples In the base year can be measured with fair 
precision for three sectors that together comprise roughly three fifths of 
GNP: 


o About 60 percent of output In Industry. 

0 About 90 perc'ent of output In agriculture. 

0 About 90 percent of employment In transportation. 

In addition, we b elieve that base-y ear coverage of trade and services Is 
nearly complete. | 

Traditionally, the Soviets have published little or no Information on 
Industries related to national security— notably military machinery, 
nonferrous metals, and some chemicals. Wherever possible, data estimated by 
analysts fill gaps In coverage of products like these. Moreover, since the 
mid-1970s Soviet publication of data has been curtailed further. Data now 


25X1 


25X1 


25X1 


25X1 


2 

CONFIDENTIAL 


Sanitized Copy Approved for Release 2009/12/09 : CIA-RDP85T01058R000507500001-9 






UL-i.il 

Sanitized Copy Approved for Release 2009/12/09 : CIA-RDP85T01058R000507500001-9 

CONFIDENTIAL 


must be estimated, for example, for the grain crop and for a greater number of 
products In the ferrous metal, chemical, and construction materials 
Industries. In these cases, however, the reason for curtailment appears to be 
concern more for cove ring up poor perf ormance than for concealing security- 
related Information. 


Although the coverage of our samples can be measured for the bape year, 
we- have no satisfactory estimates of how coverage changes over time. The most 
serious potential problem Is that samples based on data In physical units 
usually fall to reflect Introduction of new products. The resulting 
understatement In our estimates of growth Is assessed In the next section, 
along with the effects of changes In product mix and quality. That Is, we 
consider Introduction of new products, such as plastic construction materials, 
as an extreme example of Improvement In the qual ity of existing p roducts, such 
as concrete or ceramic construction materials. | 


CHANGES IN PRODUCT MIX AND QUALITY 

On balance. Improvements In the mix and quality of products probably are 
understated a little In our estimates of growth of Soviet GNP. For the 
Industrial sector, however. It Is uncertain whether these Improvements are 
understated or overstated. It Is likely that overstatement In machinery 
roughly offsets understatement In other Indu stries— primarily chemicals and, 
to a lesser extent, construction materials. | 


Industry. Within Industry, samples of products for non-machinery 
branches consist primarily of data on quantities of output In physical units 
such as tons. Items, or square meters. We value these quantities at base-year 
prices and calculate their average growth by branch and for Industry 
overall. In general, quantity data do not reflect the full extent of 
Improvements In the mix and quality of products that accompany economic 
growth. Nor do quantity data usually capture the Introduction of new 
products — an extreme case of^ quality change. Except for official Soviet 
summary statistics, however, 1 1 ttl e other Information Is available on growth 
In these branches. 


Unmeasured changes In product mix and quality probably are faster for 
chemicals than for other Industries and Important for construction materials 
as well. Nevertheless, we are able to measure some kinds of changes. For 
exampl e: 

0 Detailed estimates of auto, truck, and tractor output by 
model allow for changes In mix and Introduction of new 
model s . 

0 Explicit adjustments take quality change Into account for 
cement and flour. 

0 Standardized units of physical measure for fertilizers, generators, 
and turbines Implicitly reflect some changes In quality. 
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Moreover, in some industries average quali ty is declining, not increasing. 
Coal and iron ore are important examples. I 


For machinery, unlike other branches of industry, official Sovtet da^ on 
values of output in "constant" prices dominate our sample. Improv.ements in 
quality and introduction of new products are included— and almost certainly 
exaggerated-in these data. The main problem is that machinery producers Uke 
miflor alterations of familiar models as an excuse to raise prices. 

Sensitivity tests suggest that the resulting likely overstatement in our 
estimates of machinery growth ro ughly offsets the understatement in our growth 
estimates for other industries. 


Housing. Outside industry, growth of housing probably is underestimated 
becduse our ineasure Is based on living space. Data that would penu lt^ 
adjustment for quality change simply are not available. 


6NP Overall. Therefore, we judge that our estimates of Soviet GNP growth 
are likely to understate improvements in product mix and quality, but not by 
much. Even in Western countries, however, measures of economic growth 
generally do not capture the full extent of quality change. Reliable value 
data, which we lack, allow Western statistician s to include chang es that we 
miss, but only if their costs can be measured. 


PROXIES FOR VALUE ADDED 

Our estimates of growth of Soviet GNP are intended to reflect trends in 
real value added, which is difficult to measure. For agriculture, we use the 
procedure preferred by most Western statisticians when accurate data are 
available. Growth is estimated first for gross output— including inputs of 
goods and services processed by other sectors-and then growth of processed 
inputs is removed. For other sectors of origin, however, data limitations are 
such that we use proxies for value added. All of these proxies are common in 
western statistical practice* b ut we resort to the m more often because data 
are more limited for the USSR. ' ' 


Depending on the sector of origin, our estimates of GNP growth are based 
on several proxies for value added: 


0 Gross output, including processed inputs, for industry, 
transportation, and trade. 

0 Labor inputs, measured in work hours, for all government 
services and some other services. 


0 Processed inputs for construction. 


Most Western statisticians prefer to use gross output as a P|[OXy rather 
than calculate value added itself unless the accuracy of data on both outputs 
and inputs is high. Because value added is calculated as a difference, it is 
subject to larger errors of measurement than the output and input data from 
.hich It Is derived. (See T.P. Hill, The Iteesureiiient of Real Prod^ , Pans, 
Organization for Economic Cooperation and Development, ly/i, chapter II.) U5 
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estimates of GNP originating in industry are based on trends in value added 
itself. The Federal Reserve Board's index of US industrial production, 
however, is based on trends in gross output. Both measures show similar 
changes over time. | 


We are fairly close to standard Western statistical practice in using 
labor inputs as a pro)^ for value added in government services. Our. estimates 
for health, credit and insurance, and other miscellaneous services also are 
based on labor inputs. This departs from Western practi ce ^, but _ 1 ittle ot her 
information is available on these services in the USSR. 


NET EFFECT OF ERRORS 

The net effect of the various sources of error, both positive and 
negative, on our measures of Soviet GNP growth probably is a slight 
understatement. Our analysis indicates that this error is not likely to 
exceed half a percentage point per year and is more likely to be smaller. 

Even if the larger error persisted for 15 years, the level of GNP at the end 
of the period would be understated by less than 10 percent. This would not 
alter the order of magnitude of our Judgments about the relative sizes of the 
US and Soviet economies. Most of the impact of errors falls on estimates for 
two major sectors of origin: 

0 Industry, where errors upward and downward roughly 
balance. Growth could be either overstated or 
understated by about half a percentage point per year. 

0 Services, where growth is likely to be und erstated, but 
by less than a percentage point per year. | 

BORETSKY'S RESULTS 

Michael Boretsky argues that our estimates of Soviet economic growth are 
seriously biased downward. His major criticisms, which involve the key 
problems of measuring changes over time, are that: 

0 Our samples do not represent the range of Soviet output 
adequately . 

0 Our use of data in physical units fails to reflect 
improvements .in the quality of products. 

0 Our labor input pro)^ for value added in government and 
some other services understates growth in those sectors. 

Sanies. Our efforts to fill gaps in data are evidence that we do not, 
as Boretsky charges, limit samples to "data the Soviets choose to publish. 
For some goods— such as grain, nonferrous metals, oil products , and military 
machinery- -we try to fill gaps in published data with our own estimates, but 
the degree of accuracy cannot be ascertained. Another issue raised by 
Boretsky amounts to an indirect criticism of our samples. He extends the 
samples and methods we use for the USSR--with some adaptations— to 
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calculations of 6NP growth for the US and the Federal Republic of Germany 
(FR6). These calculations result in growth rates lower than the 
official statistics of the two countries, leadi ng him to fault o ur application 
of the samples and methods to the Soviet case. 


But Boretsky's inference does not follow from his analysis. Although we 
would agree that our samples represent the range of output in the US. and FRG 
orrty poorly, this does make them inadequate for the USSR. The Soviet economy 
differs greatly from advanced Western economies in structure, level of 
development, and general system. Even within a single country, the range of 
output can change appreciably over a long interval of time. . 

electronic consumer goods were unavailable twenty years ago in the US. And 
countries at different levels of economic development are likely to produce 
outputs that differ as much as those of a single country over many years. _ 


Quality improvements. Boretsky criticizes the extent to which we rely on 
Quantity data without mentioning our efforts to include as many changes in 
product mix and quality as information permits. He would prefer that we 
estimate real growth by using price indexes to deflate current values of 
output. Neither price indexes nor current values, however, are available in 
enough detail to make this approach feasible. Moreover, Boretsky ignores our 
reliance on Soviet value data in "constant" prices for a large and rising 
share of machinery. His picture of potential sources of error in our 
estimates of GNP growth is therefore unbalanced, focusing on sources of 
downward bias but omitting counter sources of upward bias. 


Labor inputs. Our measurement of labor inputs to services — in work hours 
unadjusted for gains in labor productivity— incurs Boretsky s criticism. For 
government services, adjustments for labor productivity are not common in 
Western countries, whose methods we try to follow. The remaining services for 
which we use work hours are a small share of Soviet GNP, and 
productivity for them is likely to have grown only slowly. If we did adjust 
for labor productivity i n these services, the effect on our estimates of GNP 
growth would be slight. I 
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OTHER POINTS 

Boretsky also argues that our measures of Soviet GNP growth in the 1950s 
and early 1960s are too low compared with estimates obtained in earlier 
Western studies. Some of those studies (by Moorsteen and Powell and by 
Kaplan) followed methods similar to ours but started from earlier base 
years. Much of the explanation for our lower estimates of growth is provided 
not by differences in samples or methods, but by our use of a more recent base 
year. As economic theory leads us to expect, the faster that output of a 
product grows— say output of calculators or computers— the cheaper it is 
likely to become relative to other products. Shifting to prices of a more 
recent base year therefore reduces the weights of faster-growing products. 

I 25X1 


Other earlier studies (Bergson's and Becker's) used methods different 
from ours. Their higher estimates are explained mostly by their reliance on 
official Soviet price indexes to convert growth in current values to real 


6 

CONFIDENTIAL 


Sanitized Copy Approved for Release 2009/12/09 : CIA-RDP85T01058R000507500001-9 







Sanitized Copy Approved for Release 2009/12/09 : CIA-RDP85T01058R000507500001-9 

CONFIDENTIAL 


growth. Because Soviet price Indexes understate Inflation, the resulting 
estimates of real growth almost surely are overstated. At th e time of the 
studies, however, alternative procedures were not available. 
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